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Abstract 

A positive definite completion problem pertains to determining whether the un- 
specified positions of a partial (or incomplete) matrix can be completed in a desired 
subclass of positive definite matrices. In this paper we study an important and new 
class of positive definite completion problems where the desired subclasses are the 
spaces of covariance and inverse-covariance matrices of probabilistic models corre- 
sponding to directed acyclic graph models (also known as Bayesian networks). We 
provide fast procedures that determine whether a partial matrix can be completed in 
either of these spaces and thereafter proceed to construct the completed matrices. We 
prove an analog of the positive definite completion result for undirected graphs in the 
context of directed acyclic graphs, and thus proceed to characterize the class of DAGs 
which can always be completed. We also proceed to give closed form expressions 
for the inverse and the determinant of a completed matrix as a function of only the 
elements of the corresponding partial matrix. 
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1 Introduction 

A pattern of a given n x n matrix is defined to be a subset of {{?', j) : 1 < i, j < n}, i.e., a 
set of positions in the matrix in which the entries are present. A (symmetric) partial matrix 
specified by a pattern is an n x n symmetric matrix in which the entries corresponding to 
the positions listed in the pattern are specified, but the rest of the entries are unspecified 
and thus free to be chosen. For example 
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is a 4 x 4 partial matrix specified by the pattern 

{{1,1},{2,2},{4,4},{1,4},{2,3}}. 

A matrix completion problem asks whether for a given pattern the unspecified entries 
of each partial matrix can be chosen in such a way that the resulting conventional matrix 
is of a desired type. Recent literature in general, and in particular matrix theory, computer 
science, statistics and signal processing have studied a variety of matrix completion prob- 
lems, such as positive definite completion IfTOll . low-rank completion [5 J and singular value 
completion Hi. 

The positive definite completion problem, one of the most well studied matrix com- 
pletion problems, asks which partial matrices have positive definite completions, with or 
without additional features. It is clear that if a partial matrix has a positive definite comple- 
tion, then it must be partial positive definite, i.e., each fully specified principal submatrix is 
positive definite. 

The work of Grone et al. IfTOl is one of the important contributions in the area of posi- 
tive definite completion. The authors prove that every partial positive matrix corresponding 
to a given pattern has a positive definite completion if and only if the specified pattern, con- 
sidered as a set of edges, forms a chordal (or equivalently decomposable) graph. A chordal 
graph is an undirected graph that has no induced cycle of length greater than or equal to 4. 
Although a positive definite completion is not necessarily unique, they furthermore prove 
that a positive definite completion matrix S is unique if one requires that Sr. 1 = for each 
unspecified position {i, j}. Interestingly, such a positive definite completion for S arose 
in an earlier paper [[8]| by Dempster within the context of maximum likelihood estimation 
for Gaussian graphical models. In light of advances in the area of graphical models in re- 
cent years, the connection between positive definite completion problems and probabilistic 
models corresponding to undirected graphs has been thoroughly exploited (see for example 

in Ha O, El, El, GB). 

In this paper we study a new class of positive definite completion problems that cor- 
responds to probabilistic models over directed acyclic graphs, abbreviated DAG models 
henceforth. DAG models, better known as Bayesian networks, are arguably one of the 
most widely used classes of graphical models. The need for studying this new class of 
problems naturally arises when studying spaces of covariance and inverse covariance ma- 
trices corresponding to DAG models [3|. These spaces are essential features of a DAG 
model. In the DAG setting, we consider specific positive definite completions of partial 
matrices that are specified by a pattern determined by the edges of a directed acyclic graph 
D. Here the partial matrices are desired to be completed in the space of covariance or 
inverse-covariance matrices corresponding to DAG models. 

A great advantage of positive definite completion problems for DAGs, as we shall de- 
termine in this paper, is that we are able to present fast decision procedures to not only 



2 



determine whether a given partial matrix can be completed in either of the aforementioned 
spaces above, but we are also able to fully construct the completed matrices. This high- 
lights the tractable nature of completion problems for DAGs as compared with those of 
undirected graphs, where no such completion procedures are known to exist, unless the 
graph is decomposable. Even in case of a decomposable undirected graph Q, we shall see 
that the same positive definite completion can be achieved under a directed version T> of Q. 
In this sense our result aims to generalize the existing results for completing partial positive 
definite matrices corresponding to undirected graphs. 

The organization of the paper is as follows. In Owe briefly review the basics of graph- 
ical models and in particular Gaussian graphical models for both undirected and directed 
graphs. In §[3] first we formally define two types of positive definite completion problems 
for DAGs and then, among some other results, we present two fast procedures of polyno- 
mial complexity that determine whether a partial matrix can be completed in the desired 
space, and specify a way to uniquely construct the completed matrix. The uniqueness of 
this completion has tremendous benefits for Bayesian analysis of DAG models (see for 
more details). In §@]we prove an analog of Grone et al.'s IfTOll theorem but in the context 
of DAGs, and also demonstrate subtle differences between the completion problems for 
DAGs vs. undirected graphs. In §[5] we provide expressions for directly computing the in- 
verse and the determinant of the positive definite completion of a partial matrix, without 
actually carrying out the completion. 

2 Preliminaries 

2.1 Graph theoretic notation and terminology 

A graph Q is a pair of objects (V, Y), where V and Y are two disjoint finite sets represent- 
ing, respectively, the vertices and the edges of Q. Each edge e e "V is either an ordered 
pair (v, V) or an unordered pair {v, v'}, for some v, V e V. An edge (v, V) e V is called 
directed where v is said to be a parent of V , and V is said to be a child of v. We write this as 
v — » V . The set of parents of v is denoted by pa(v), and the set of children of v is denoted 
by ch(v). The family of v is fa(v) = pa(v) U {v}. An edge {v, V) e T is called undirected 
where v is said to be a neighbor of v', or V a neighbor of v. We write this v ~g V . The set 
of all neighbors of v is denoted by ne(v). We say v and V are adjacent if there exists either 
a directed or an undirected edge between them. The boundary of v, denoted by bd(v), is the 
union of parents and neighbors of v. A loop in Q is an ordered pair (v, v), or an unordered 
pair {v, v} in "V . For ease of notation, in this paper we always shall assume that the edge 
set contains all the loops, although we shall draw the respective graphs without the loops. 

An undirected graph is a graph with all of its edges undirected, whereas a directed 
graph, "digraph", is a graph with all of its edges directed. In this section, we shall use the 
symbol Q to denote a general graph, and make clear within the context in which it is used, 
whether Q is directed or undirected. 
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We say that the graph Q' = (V, is a subgraph oiQ = (V, f\ denoted by Q' c Q, 
if V c V and y c y . In addition, if 0' c and f = VxVn ^, we say that 0' is an 
induced subgraph of Q. We shall consider only induced subgraphs in what follows. For a 
subset A c V, the induced subgraph @ A = (A,A x A C\ Y) is said to be the graph induced 
by A. A graph Q is called complete if every pair of vertices are adjacent. A clique of Q 
is an induced complete subgraph of Q that is not a subset of any other induced complete 
subgraphs of Q. More simply, a subset A Q V is called a clique if the induced subgraph Q A 
is a clique of Q. The set of the cliques of Q is denoted by 'tfg. 

A path in Q of length n > 1 from a vertex v to a vertex V is a finite sequence of dis- 
tinct vertices v = v,...,v„ = V in V such that (v*_i, v^) or {v^-i, v*} are in y for each 
& = 1, . . . ,n. We say that the path is directed if at least one of the edges is directed. We say 
v leads to V , denoted by v i — > V, if there is a directed path from v to V . A graph Q = (V, Y) 
is called connected if for any pair of distinct vertices v, V e V there exists a path between 
them. An rc-cycle in Q is a path of length n with the additional requirement that the end 
points are identical. A directed n-cycle is defined accordingly. A graph is acyclic if it does 
not have any cycles. An acyclic directed graph, denoted by DAG, is a directed graph with 
no cycles of length greater than 1 . 

The undirected version of a graph Q = (V,Y), denoted by Q u , is the undirected graph 
obtained by replacing all the directed edges of Q by undirected ones. An immorality in 
a directed graph Q is an induced subgraph of the form i — > k < — j. Moralizing an 
immorality entails adding an undirected edge between the pair of parents that have the 
same children. Then the moral graph of Q, denoted by Q m , is the undirected graph obtained 
by first moralizing each immorality of Q and then making the undirected version of the 
resulting graph. Naturally there are DAGs which have no immoralities and this leads to the 
following definition. 

Definition 2.1. A DAG Q is said to be "perfect" if it has no immoralities; i.e., the parents 
of all vertices are adjacent, or equivalently if the set of parents of each vertex induces a 
complete subgraph of Q . 

Given a directed acyclic graph (DAG), the set of ancestors of a vertex v, denoted by 
an(v), is the set of those vertices v" such that v" i — > v. Similarly, the set of descendants 
of a vertex v, denoted by de(v), is the set of those vertices V such that v i — > V . The set of 
non-descendants of v is nd(v) = V \ (de(v) U {v}). 

An undirected graph Q is said to be decomposable if no induced subgraph contains 
a cycle of length greater than or equal to four. A constructive definition in terms of the 
cliques and the separators of the graph Q can also be specified. The reader is referred to 
Lauritzen IfTSl for all the common notions of decomposable graphs that we will use here. 
Decomposable (undirected) graphs and (directed) perfect graphs have a deep connection. 
In particular, it can be shown [|9l[l2]| that if Q is decomposable, then there exists a directed 
version of Q, i.e., a digraph T> such that D u = Q, where D is a perfect DAG. 
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2.2 Graphical Gaussian models 

A graphical model over a graph Q is a family of probability distributions on a common 
probability space such that each distribution satisfies the set of conditional independences 
described by Q. Two important classes of graphical models are Markov random fields 
(or undirected graphical models) and Bayesian networks (or directed graphical models). 
Henceforth in this paper, we shall assume that Q = (V, Y) is an undirected graph and 
D = (V, S) is a directed acyclic graph (DAG), both with the same vertex set V = {1, . . . , p}. 
A random vector X = (X\, . . . ,X p ) e W belongs to a Markov random field over Q if it 
satisfies the pairwise Markov property^ w.r.t. Q, i.e., 



(i, j) t f => X t Ji Xj\ (X k :keV\ [i, ;}) . 



(2.1) 



For a set A c V let X A = (X, : i e A). The random vector X belongs to a Bayesian network 
over a DAG D if it satisfies the directed local Markov property w.r.t. D, i.e., 



Xj JI X n d(,)|X pa(i ) Vz 6 V. 
We now give examples of such models. 

-© o -0 



(2.2) 




r 



(b) 



Figure 1 : An undirected four cycle and a directed version. 



Example 2.1. 



(a) Let us consider the four cycle C4 in Figure [T(a)j Then a random vector (Xi , . . . , X4) € 
K 4 satisfies the global Markov property w.r.t. C4 implies 

Xi 1LX 4 \(X 2 ,X 3 ) and X 2 1L X 3 \(X U X 4 ). 



(b) Let us consider the DAG D given in Figure |l(b)| Note that D is a directed version 
of C 4 . Now a random vector (X\, . . . ,X 4 ) satisfies the directed Markov property w.r.t. 
T> implies 

X t 1LX 4 \(X 2 ,X 3 ) and X 2 JL X 3 \X 4 . 

Important subclasses of the models defined above arise when X is multivariate Gaus- 
sian; namely the Gaussian Markov random field over Q and the directed Gaussian random 
field over D, denoted by JV (@) and <yV(!D), respectively. More precisely, Jf{@) denotes 



'More precisely, a Markov random field is a probability distribution that satisfies the local Markov prop- 
erty, which is in general a stronger property than the pairwise Markov property. However, when P has a 
positive density w.r.t. a Borel measure these two properties are equivalent. 
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the family of multivariate normal distributions N p (pi, 2), p e W, 2 e PD P (R) (abbreviated 
2 > henceforth), that obey the local Markov property w.r.t. Q. The family of distributions 
jV{Q) is often referred to as the Gaussian graphical or Gaussian undirected model over Q. 
Likewise, jV{D) denotes the family of multivariate normal distributions N p (ju, 2) that obey 
the directed local Markov property w.r.t. D. We shall refer to jV(!D) as the Gaussian di- 
rected acyclic graph or DAG model over T>. It turns out that in both of these Gaussian 
graphical models, the required Markov property is reflected in 2 in terms of certain alge- 
braic equations of the entries of 2 depending on the structure of the underlying graph. The 
description of the equations in JV(Q) is quite simple. We have N p (ju, 2) 6 jV{Q) if and 
only if 

Rj}^r=>27. 1 =0. (2.3) 

In order to express the equations satisfied by 2 when N p (ju, 2) e j¥{T>), first we establish 
a few (and to some degree standard) notations for DAG models 

First note that the relation v — > V defines a partial order on the vertex set of T>. Since 
any partial order can be extended to a total order, we can therefore assume without loss 
of generality that the vertices are numbered in such a way that i — > j implies that i > j, 
V?', j 6 V. By this convention a random vector X 6 W obeys the directed local Markov 
property w.r.t. D (or more precisely an equivalent version of it called the ordered Markov 
property - see (6l for details) if and only if 

Xj jl X pr(y) |X pa0) Vj e V, (2.4) 

where pr(j') = {i : i > j , i <£ pa(j')} is called the set of predecessors of j. 

Now for A, B c V let 2 A B denote the |A| x \B\ submatrix of 2 with rows indexed by A and 
columns indexed by B. We often write 2 A for the principal submatrix 2 A A , 2 A j for 2 A (yl 
and similarly 2 y -, B for 2^. By a result in [1] N p (ju, 2) e Jf(T>) if and only if 2 > and 

Note that if pa(j') = 0, then Equation (12.41 ) implies thatX 7 Ji X pr(y ). In particular, this implies 
that 2 pr ( 7) j = 0. To include this situation in Equation (|2.5I) we shall use the convention 
£pa(/) = 1 and 2p a Q-)j = 0. Equation (|2.5I) also illustrates how the directed local Markov 
property is reflected in the entries of 2 in terms of algebraic equations. We now proceed 
to define the Schur complement of a symmetric positive definite matrix. Consider a p x p 
symmetric matrix M partitioned as follows: 

M = l M < M 

\ M n Mj ) 

where {/, 7} is a partition of {1, 2, ... ,p). Note that the matrix M is positive definite if and 
only if Mi is positive definite and Mj\i = Mj - M JI Mj l M IJ is positive definite. The matrix 
Mj\i is called the Schur complement of A/ 7 in M. 
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3 The positive definite completion problem for DAGs 



In this section we propose two polynomial time procedures involving rational functions for 
completing partial positive definite matrices to positive definite matrices that correspond 
to Gaussian Bayesian networks ^V(D). In addition, these completion problems, as we 
will explain later, are also generalizations of the classical positive definite problem in IfTOll . 
To formalize the completion problem that we discuss in this paper, we introduce some 
definitions and notation. 

3.1 Preliminaries 

Let D = (V, <S) be a DAG. A ©-partial matrix is a symmetric function 

T : {(/, j) : {i, j} such that T, 7 = T((i, j)) = I> V{i, j} G Y, 

where Y is the edge set of the undirected version of the DAG D. The set of all D-partial 
matrices, denoted by l v , is a real linear space of dimension |<#|. Recall that ^ denotes the 
set of cliques of D. Now for each clique C 6 ^£>, the restriction of Y to C, denoted by Y c , 
is a |C| x |C| matrix (T,-y)/j eC . A partial positive definite matrix over D is a D-partial matrix 
T such that r c > for each C e The set of all partial positive definite matrices over T> 
is denoted by Q©. A partial matrix over an undirected graph Q, or a partial positive definite 
matrix over an undirected graph Q, can be similarly defined. Next we define two sets; the 
set of covariance matrices and the set of inverse-covariance matrices corresponding to a 
Gaussian Bayesian network ^Y(D). More precisely, these spaces are, respectively: 

PD D = {S : N p (0, 2) e ^(D)} and P D = {Q : Q 1 e PD D ) . 

Similarly, for an undirected graph Q = (V, Y) we define 

PD^ = {S : N p (0, S) 6 ^(@)) and = |Q : £T l 6 PD^} . 

Remark 3.1. Note that by Equation (|2.3I) S e PD^ if and only if Sr. 1 = whenever {i, j} i 
t. 

A characterizing feature of a Gaussian Bayesian network J^{D) is that the structure 
of the underlying DAG (i.e., the graph itself), in terms of the missing arrows, can be fully 
recovered from the lower triangular matrix in the Cholesky decomposition of Q. = 2T 1 e 
P ffl . The following remark formalizes this fact. 

Remark 3.2. Let X» denote the linear space of all lower triangular matrices with unit diag- 
onal entries such that 

L e L<d => Uj = for each (i, j) £ £ '. 

Then Q 6 P^ if and only if there exists a lower triangular matrix L e X© and a diagonal 
matrix A, with strictly positive diagonal entries, such that in the modified Cholesky de- 
composition Q, = LAL' ifTTl [Tl l3l. In addition, the modified Cholesky decomposition is 
unique. 
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We now discuss the relationships between the spaces PD© (or P©) and its undirected 
counterpart PD^y. (or P©u). In particular, the modified Cholesky decomposition property of 
Q. € P in Remark 1X21 above implies the following. 

Lemma 3.1 (Wermuth ifTTIO . Suppose T> is an arbitrary DAG. Then PD© c PD m, where 
the undirected graph D m is the moral graph ofD. 

Proof. Suppose S e PD©. Let Q = S 1 = LAL' be the modified Cholesky decomposition 
of Q. e P^). It is required to prove that Q is also in P^m. In light of Equation [23] it suffices 
to show that if i and j are non-adjacent in D m , then Q, 7 = 0. On the contrary, suppose that 
Clij + 0. Therefore 

p 

Qij = ^ A kk L ik L jk * 0. 
k=\ 

since A** > 0, this implies that there exists k such that L ik + and L jk + 0. Consequently, 
i — > k and j — > k. Hence i and j are parents of k which in turn implies that i and j are 
adjacent in D m , yielding a contradiction. □ 

Proposition 3.1. IfD is a perfect DAG, and Q = D" is the undirected version ofD, then 
PD V = FD @ . 

Proof. Suppose D is a perfect DAG. Thus £> m = Q and by Lemma ED PD^ £ PD^. Now 
to establish the other inclusion, assume that S e PDg:. Let S" 1 = LAL' be the modified 
Cholesky decomposition of 2T 1 . By Remark I3T21 it suffices to show that if (i, j) i $ and 
i > j, then Ljj = 0. Note however that (i, j) £ § implies that {i, j} £ Y. Therefore 

= Z7. 1 = AjjLij + 2^ A kk L ik L jk . 

Assume to the contrary that L, 7 # 0, then there exists an index k such that L ik ± and 
Lj k ± 0. This in turn implies that there exists an immorality i ' — > k <— j since by assumption 
(z, j) i <§ . We have thus reached a contradiction to the fact that D is perfect. Therefore 
L e £,£, and consequently 2T 1 eP fl or!e PD^. □ 

Remark 3.3. Note that the statement of Proposition l3.1l can be rephrased as follows: if D is 
a perfect DAG, then a normal distribution obeys the directed local Markov property w.r.t. 
D if and only if it obeys the pairwise Markov property w.r.t. D u , the undirected version of 
D. It can be easily shown that if Q is a perfect DAG, the above statement holds in more 
generality than just for normal distributions [fT2|. 

Convention: Hereafter in this paper, and unless otherwise stated, we assume that Q = 
(V, f) is the undirected version of the DAG D = (V, S\ i.e., Q = D u . 

Definition 3.1. Let M be a subset of the space of p x p symmetric matrices, denoted by 
Sp(R). We say that a D-partial matrix T can be completed in M if there exists a matrix 
T 6 M such that 7y = T, ; for each (i, j) e S '. We refer to T as a completion of Y in A1, or 
simply a completion of T if A1 is S P (R.). 
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Similar definitions can also given in the context of undirected graphs, i.e, the comple- 
tion of ^-partial matrices. 



Corollary 3.1. Let D be a perfect DAG and let Q = D u denote the undirected version of 
T). Then f 6 can be completed in PD if and only if it can be completed in PD^. 



3.2 Positive definite completion in 

An important question in the probabilistic analysis of directed Markov random fields/DAGs 
is whether a D-partial matrix can be completed in P©, i.e., whether a given D-partial 
matrix corresponds to an inverse covariance matrix of a DAG model. Similar questions 
can be asked about completions in PD . These are inherently algebraic questions. Note 
that Remark [3T21 implies that one can potentially recover the full matrix Q merely from the 
entries that correspond to the edge set of T>. We formalize this statement in the proposition 
below. 

Proposition 3.2. Let Y be a D-partial matrix in L> If Y n ^ 0, then 

(a) Almost everywhere (w.r.t. Lebesgue measure on there exist a unique lower trian- 
gular matrix L e and a unique diagonal matrix A e M, pxp such that Y = LAL' is 
a completion ofT. 

(b) The matrix Y is the unique positive definite completion of Y in P© if and only if the 
diagonal entries of A are all strictly positive. 

Proof, (a) First we shall show that, almost everywhere w.r.t. Lebesgue measure on \ , Y 
can be uniquely completed to a matrix Y in S p (R), not necessarily positive definite, such 
that T = LAU, for some L e X© and a diagonal matrix A 6 R pxp . We shall use the 
Cholesky factorization algorithm |fT6l to construct A and L, column by column, in the 
following steps. 

i) Set L u = for each (z, ;) <f. S. 

ii) Set An = Tn, La = ^il^a for each i 6 pa(l) and set j = 1. 

Hi) If j < p, then set j = j+1 and proceed to step iv), otherwise L and A are constructed 
such that they satisfy the condition in part (a). 



v) For each i e pa(j') if A ; - ; ^ 0, then set Ly = A 7 j(r,- 7 - \ A kk L ik Lj k ), and return to 



step in). If Ajj = 0, then no completion of Y exists that satisfies the condition in part 
(a). Consequently, Y cannot also be completed in P^. 



Proof. The proof is immediate from Proposition 13.11 



□ 





k=i 
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Note that for each 1 < j < p, the expression for Ajj given by Yjj - ^ A^L^. in step iv), 

k=\ 

considered as a function of r, 7 , (i, j) e S, is a rational function, say /> y (r). In particular, 
almost everywhere w.r.t. Lebesgue measure on \ , A yy = pj(Y) + for all 1 < j < p. 
Therefore, almost everywhere, the process above yields matrices L and A that satisfy the 
condition in part (a). 

(b) Part (b) now follows from part (a) and Remark [3721 □ 

Remark 3.4. It is clear from Proposition 13.21 above that a positive definite completion of T 
in P© is not always guaranteed. Moreover, the ability to complete in P is not known be- 
forehand, and is determined as a byproduct of having gone through the completion process 
itself. Having said this, if at any stage a Ajj becomes negative or zero, it is evident from 
Proposition 13.21 that a completion in P© is no longer possible and the completion process 
can be terminated. 

We now demonstrate the completion outlined above on a partial matrix r e I©. 




Figure 2: Completion in V . 



Example 3.1. Consider the DAG T) given by Figure[2]and the ©-partial matrix Y given by 



r = 



( 1 


* 


* 


-3 


* 


41 


* 


-1 


-2 


* 


-5 


2 


* 


-2 


-2 


-10 


* 


* 


-3 


* 


-10 


56 


3 


* 


* 


-5 


* 


3 


-30 


* 


,4 


2 


* 


* 


* 


13, 



Now by applying the completion process in Proposition l3.2l to Y we obtain 



A = 
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which yields the completed matrix T given as follows: 



r = 



' 1 








-3 





4 ^ 
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-2 
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However, as the diagonal elements of A are not strictly positive, F cannot be completed in 
Pi). 

3.3 Positive definite completion in PD© 

An equally important question is whether a D-partial matrix can be completed in PD©, the 
space of covariance matrices corresponding to the DAG model jY(£f). Recall that from 
Equation (12.51) we have 

S e PD© <==> S > and = £ pr (/),pa(./)(?pa(./)) ^pa(j)j VjeV. (3.1) 

By recursively applying Equation (13.11 ) we show below that it is possible to determine 
whether a ©-partial matrix can be completed in PD©. The procedure is described in the 
following proposition . 

Proposition 3.3. Let Y e Q D , then 

(a) There exists a completion process of polynomial complexity that can determine whether 
r can be completed in PD^; 

(b) If a completion exists, this completion is unique and can be determined construc- 
tively using the following process: 

(1) Set = Tij for each {i, j) e V and set j = p. 

(2) If j > 1, then set j = j - 1 and proceed to the next step, otherwise 2 is successfully 
completed. 

(3) If SfaQ-) > 0, then proceed^ to the next step, otherwise the completion in PD^ does not 
exist. 

(4) Ifpr(j) is empty, then return to step (2), otherwise proceed to the next step. 

(5) //pa(j') is non-empty, then setl, pr{j)j = Sp r(;) ,p a(;) (2 pa0) )" 1 S pa(7X y, E ; ; pr0) = and 
return to step (2). Ifpa(j) is empty, then set ^ P r(j)j = and return to step (2). 

Remark 3.5. Note that we can shorten step (5) by making the following convention. For 
any two distinct sets I,JQ V if / = 0, then set Y,J [ = 1 and £// = 0. This convention will 
automatically take into account the case when pa(j') is empty. 

2 Note that for each j, the submatrix Ef a (/) is fully determined by step (2). 
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Proof. Note that the completion process above starts with the the highest label vertex in 
T> (this vertex is called a "source" node and does not have any parents) and the algorithm 
proceeds in a descending manner. In the process above the positive definiteness condition 
of the completed matrix will be guaranteed by requiring that each principal submatrix, 
starting from the highest label and moving down, is positive definite at every step, i.e., 
positive definiteness is maintained layer by layer. Now suppose that down to an integer 
1 < i < p, the process described above has succeeded in uniquely constructing a positive 
definite matrix that corresponds to the principal submatrix f+1 p | of 2. Therefore, the 
process returns to step (2) with j = i — 1 and then proceeds to step (3). By this step 
note that 2f a(; -) is fully determined because, (a) the submatrix £ pa ( ; ) is specified since it is a 
submatrix of E^+i,..,^}, where the latter is already determined by the end of the previous 
step, and (b) the row £ ; , pa o) is specified since it corresponds to directed edges in the DAG 
(i.e., T e Qjo). Hence £f a(J ) is fully determined by the beginning of this step. If Sf a(; ) is not 
positive definite, then the completion in PD© c PD P (R.) cannot exist as all the principal 
submatrices of a positive definite matrix also have to be positive definite, i.e., Sf a(;) > is 
a necessary condition to continue with the completion process. We now proceed to show 
that the condition S ta(;) > is also sufficient for the completion process. In particular, the 
condition Ef a(i) > and Equation (13.11 ) as in step (5) uniquely determine the unspecified 
entries of the j-th column and row of the new submatrix Eyj+i ,..., P }. To see this write 



^j,pa(;) ^;',pr(7) 
£pa(;)J £pa(;) £ pa (j), P r(j) 
V^prQOJ ^pr(;),pa(;) ^pr(j) 



Thus we have 



y _ { ^;',prO')| y y \ /y \-l | ^pa(;')J 



^pa(;),pr(;') 



^;7lpa(;') ^;',pr(7) £;,pa(./)(£pa(./)) 1 £ pa (y), pr (j) \ 

^prO')J _ Epr(;),pa(;)(2 pa ( 7 ')) £pa(j)J £pr(;)|pa(;) J 

%pa« \ Qi (32) 

U ^pr(i)|pa(;)/ 

Note that in the second last step we have used the expression 

^prO')J = ^pr(i),pa(i)(2 pa ( ; )) ^pa(j\j 

from step (5). The positive definiteness in the last step follows respectively from the facts 
that, (a) £/,1 P a(j) > as this is equivalent to assuming 2 fa(;) > since S pa(i) > 0, and, (b) 
S pr( y)| pa ( 7 ) > since it corresponds to a Schur complement of a principal submatrix of the 
positive definite matrix £{yj+i,...,p}. □ 

Remark 3.6. Note that in Proposition [33] if we require S fa(;) in step (3) to be only invertible, 
instead of positive definite, then by a similar argument as in the proof of !3.2[ we can show 
that, almost everywhere w.r.t Lebesgue measure on I , the process in Proposition l3.3l yields 
a matrix, not necessarily positive definite, S 6 W xp that satisfies Equation (12.51) . 
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We now proceed to illustrate the completion process in Proposition 13.31 using two ex- 
amples. The first example illustrates the completion process symbolically and the second 
example applies to a D-partial matrix with numerical entries. 




(a) (b) 



Figure 3: Completion in PD^ from Example 13 .21 



Example 3.2. (a) Consider the DAG D given in Figure [3(a)j A partial matrix corresponding 
to D can be written symbolically as 



r = 





Tl2 


Tl3 


* > 


r 2 i 


^22 


* 




r 3 i 


* 


r 33 


r 34 


, * 


^42 


r 43 


^44) 



where incomplete entries in T are denoted by *. We now proceed in layers using the steps 
in Proposition [33] as j decreases from 4 to 1. 



Layer: j=4 

In step (1) of the procedure described in Proposition 13 .31 we have 



S = 



%1 


z 12 


£13 


? \ 


^21 


^22 


7 


S 2 4 




7 


£33 


^34 


I ? 


Z 42 


£43 


^44, 



Layer: j=3 

In step (2) let j = 4 - 1 =3. In step (3) either S fa(3) = |^ 33 ^ 34 ) > 0, otherwise the 

\A43 ^44/ 

completion in PD© does not exist. Assuming the former, we proceed to step (5). Since 
pr(3) = 0, the layer down to j = 3 is thus completed. 



Layer: j=2 

We now return to step (2) with j = 3 — 1 =2. In step (3) we check whether Sf a(2 ) = 

/I22 2 2 4| > Assummg 5^ > q 5 t hen in step (5), as pr(2) = {3}, we set S 32 = S^E^S^ 
y-42 ^44 ) 

and the layer down to j = 2 is thus completed. 
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Layer: j=l 

Now the process is returned to step (2) with j = 2 - 1 = 1. In step (3) we first check 
whether 

1 £12 ^13 

^-21 ^22 ^34^44 2, 

, -31 ^"34^44 ^42 ^33 

Assuming E fa(1) > 0, then in step (5), as pr(l) = {4} we set 



-fa(l) - 



> 0. 



£41 - (£42, £43) 



^22 
^34 £44^42 



£34^44 ^42 



-33 



221 
£31 



Now all the unspecified entries are determined and the completed matrix 2 is said to be the 
completion of Y in PD^. 



(b) Consider the DAG T> given in Figure [3(b)] and let 



' 1 


0.3 


* 


0.4 


0.6^ 


0.3 


1 


0.4 


* 


* 


* 


0.4 


1 


-0.3 


0.5 


0.4 


* 


-0.3 


1 


* 


,0.6 


* 


0.5 


* 


1 , 



Now by applying the procedure in Proposition [331 we start with j = 5 - 1 =4. First note 
that Ef a (4) = E 44 > 0. In step (5) we set £45 = 0, since pa(4) = 0. In the next layer we have 
7 = 3 and it can be easily verified that 



( 1 -0.3 0.5 



-fa(3) - 



-0.3 
^ 0.5 



1 







1 



>0. 



Now pr(3) is empty so by step (4) we return to step (2) since (5) in the completion process 
is redundant. Now in step (3) for j = 2 it is obvious that 



-fa(2) 



1 0.4 
0.4 1 



> 0. 



Therefore we proceed to step (5) and calculate £ pr (2),2 = (£42,^52) = (-0.12,0.2). Moving 
to j = 1 , it is easily verified that 



2f a (l) - 



' 1 


0.3 


0.4 


0.6 


0.3 


1 


-0.12 


0.2 


0.4 


-0.12 


1 





,0.6 


0.2 





1 



> 0. 



Finally, we proceed to step (4), where we have 2 pr (i),i = £31 and we set 



E31 =(0.4,-0.3,0.5) 



1 -0.12 0.2 



-0.12 
0.2 



1 






1 



X" 1 


'0.3' 




0.4 


/ 


lo.ej 



= 0.2437. 



14 



The process now terminates and the unique completion of T in PD© is given by 



1 


0.3 


0.2437 


0.4 


0.& 


0.3 


1 


0.4 


-0.12 


0.2 


0.2437 


0.4 


1 


-0.3 


0.5 


0.4 


-0.12 


-0.3 


1 





0.6 


0.2 


0.5 





1 J 



e = 



In order to double check that E is indeed in PD© we first compute E 



Q = E" 



t 2.353 
-0.567 


-1.009 
-1.298 



-0.567 
1.327 
-0.476 
0.243 
0.313 





-0.476 
1.706 
0.455 

-0.758 



-1.009 
0.243 
0.455 
1.569 
0.330 



-1.298^ 
0.313 
-0.758 
0.330 
2.095 ) 



' 1.534 











m 


-0.370 


1.091 














-0.436 


1.231 








-0.658 





0.369 


1 





-0.846 





-0.616 





ij 



Now the lower triangular matrix R in the standard Cholesky decomposition of Q is given 
by 



R 



which clearly shows that the lower triangular matrix L in the corresponding modified 
Cholesky decomposition of Q. is in X©. 

Proposition l3.3l establishes conditions under which a D-partial matrix can be completed 
in PD©. It therefore establishes conditions for the existence and uniqueness of the com- 
pletion. A natural question to ask is if there are simple conditions which guarantee this 
completion. We now deduce from Proposition 13 .31 that if the digraph D is a perfect DAG 
then T 6 can always be completed in PD S . 

Corollary 3.2. Let T) be a perfect DAG and Y e I©. Then a necessary and sufficient 
condition for completing Y in PD© is that Y e Q©. Moreover, ifYe Q®, then Y can be 
simply completed to E e PD as follows: 
Yn for each {i, j} e "V , 



(a) Set E i7 - . y 



(b) Set E, 



pr(7)J 



Zpr(;),pa(;) E pa( j) E pa (j) J 



and I 7iPr0) = E prC/) J for each j = p - 1, . . . , 1. 



Proof. (=>) If T i Q-o, then T cannot be completed to a positive definite matrix. This 
follows easily from the fact that the principal minors of a positive definite matrix are all 
strictly positive. In particular, if a completion for Y in PD© exists, then Y c > for each 
Ce^g, which implies that Y 6 Q©. 

(<=) Now assume that Y 6 Q . As D is perfect, by definition there are no immoralities 
present in D, (i.e., all parents of each node are adjacent). Hence fa(j') is a complete subset 



of V for each j. It is therefore contained in a clique of £), and hence E 



fa(/) 



fa(7) 



> since 



r e Q©. Thus step (3) of the completion process in Proposition 13 .31 is always satisfied and 
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can thus be omitted from the procedure. We can therefore conclude that Y can alway be 
completed in PD . 

Now since S pa(i) are all already available step (5) can be performed for j = p - 1, . . . , 1. 
The proof of Proposition 13 .31 demonstrates that after performing these steps, we obtain the 
completion of Y in PD . □ 

An alternative but similar procedure to that in Proposition 13.31 for completing a .ID- 
partial matrix Y in PD S is to construct a finite sequence of DAGs, 2) (0) , . . . , D {n) such that 
T> {n) at the end of this sequence is perfect, and then a partial matrix, Y (n) over The 
first DAG in this sequence is £) (0) = D. If D {0) is not perfect, then for each immorality of 
the form i — » k <— j in D (0) with i > j we add a directed edge i — » j to the edge set of 
D (0) . Let be the DAG with added edges. It is clear that D (0) is an induced subgraph of 
We continue this process until we obtain a perfect DAG. Therefore, we have a finite 
sequence © (0) , . . . , T> (1X) of DAGs such that D (M) at the end of this sequence is perfect. Now 
starting from the largest vertex j, we use Equation (13.11) to compute the entries r|" } that 
correspond to added edges i — > j in T> (n) . Unless for some j the requirement £ pa(y ) > is 
not met in Equation (|3.1I) . this process succeeds in filling in those unspecified entries of S 
that correspond to D {n \ i.e., we obtain a partial matrix over Since D (n) is a perfect 
DAG, by Corollary I3.2[ the partial matrix can be completed in PD B (») if and only if it 
belongs to Q^w. Furthermore, Y (n) can be completed by following the simple non-recursive 
completion procedure described in Corollary |3.2l It is clear that completion of r (,l) in PD^m 
is also the completion of Y in PD©. We illustrate this alternative procedure by an example. 




(c) (d) 



Figure 4: A finite sequence Do, T>\,T>% of DAGs and the undirected version of D 2 ■ 

Example 3.3. Let D be the DAG in Figure [4(a)j Starting from D = T), the only immorality 
in this DAG is 5 — » 1 <— 2. By adding the directed edge 5 — > 2 we obtain T>\ in Figure 
|4(b)[ Next we obtain the perfect DAG D 2 in Figure [4(c)| by adding the directed edge 5 — > 3 
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corresponding to the immorality 5 
©-partial matrix 



2 <— 3 in T>\. Now consider the completion of the 



(Tn 




* 


* 




r 2 i 


r 22 


r 2 3 


* 


* 


* 


L32 


T33 


r 34 


* 


* 


* 


r 43 


r 44 


r 45 


Tl5 


* 


* 


r 54 


T55, 



From Equation [3J] we compute 

T53 = r^r^T^, and r 52 = r 5 3r 33 r3 2 = ^r^^r^ 1 ^. 

Thus we obtain the following partial matrix over the perfect DAG D2 (or over the decom- 
posable graph in Figure |4(d)| ): 



(Tn 


Tl2 


* 


* 


r 15 ^ 


r 2 i 


r 2 2 


T23 


* 


r54r 44 r43 


* 


^32 


T33 


r 34 




* 


* 


r 43 


r 44 


r 45 


Tl5 


r54r 44 T43 


r53r 33 1 r32 


r 54 


T55 t 



4 Completable DAGs and generalization of Grone et al .[ 10] 's 
result 

A pertinent question in the positive definite completion problem for DAGs is the class of 
DAGs for which the completion of a partial matrix in PD^ is certain to exist. Corollary 
13 .21 asserts that if D is perfect and the ©-partial matrix Y e then a completion in PD^ 
always exists. Is the class of perfect graphs maximal in the sense that only for this class of 
graphs is completion guaranteed for all Y e ? It is evident that a necessary condition for 
the existence of the completion in PD ffl , or any positive definite completion for that matter, 
is that T is a partial positive definite matrix over D, i.e., Y e Q^. 

Theorem 4.1. Every partial positive definite matrix over D can be completed in PD if 
and only if D is a perfect DAG. 

Proof. We proceed using a proof by contradiction embedded in an induction argument. 
Assume the statement of the theorem is true for any DAG s.t. |V| < p. We shall prove the 
theorem for |V| = p. The case p = 1 is trivially true, hence let p > 2. Let £>m denote the 
induced DAG on V \ {1}. 

=>) Suppose that every partial positive definite matrix over D can be completed in 
PD ffl . Let be an arbitrary element in Q© [ir Now let us define the D- partial matrix Y 
such that for each {i, j) e V 



T7 = 



1 if/ =1,7 = 1, 
if/=l, 7*1, 
otherwise. 



-[i] 
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It is clear that T is a partial positive definite matrix in Q©. By assumption, F can be com- 
pleted to a positive definite matrix 2 in PD©. Now note that the principal submatrix 2y\{i} is 
positive definite and satisfies Equation (13.11) w.r.t. In particular, is the comple- 
tion of in PD 2 ) UJ . By the induction hypothesis this implies that D m is a perfect DAG. 
Therefore, to show that D is perfect, it suffices to show that pa(l) is a complete subset of 
V. On the contrary, if pa(l) is not complete, then there are non-adjacent vertices e V 
such that j'i —* 1 <— Assume w.l.o.g that ij > 7*1. In particular, this implies that is a 
predecessor of 7*1, i.e., i\ e pr(7i). Fix an arbitrary number e in the open interval ( V2/2, 1). 
Consider the D-partial matrix Y that is defined for each {?', 7} 6 V as 



r« = 



1 if z = 7, 
e if i = 1, 7 
otherwise 



71 or j = z 1; 7 = 1, 



One can easily check that Y e Q^. Let 2 denote the completion of T in PD ffl . Since 
s pa0'i),7i = r pa ( ;i ), ; - 1 = from Equation (13TTT) we have 

^pr(i'i),7i = ^pr(A),pa(7i)(2pa(ji)) ^pa(/l).Jl = ^- 

In particular, 2,-j, = 0. Therefore 



n 6 e 

6 1 
£ 1 



>0. 



However, this matrix is positive definite if and only if e e (0, V2/2), yielding a contradic- 
tion. 



<=) Let D be a perfect DAG and T e Q^,. Let be the restriction of Y to V \ {1} 
and the completion of in PDa [ir Now define 2 as follows: 

Ey\{i} = 2 , 2f a (i) ; i = Tf a (i) ; i and 2 pr ( 1 ) 1 = 2 pr ( 1 ) i p a ( 1 )(2 pa ( 1 )) 1 2 pa ( 1 ) 1 . 

Then using Equation (13.21) when 7 = 1 shows that 2 > 0. □ 

Remark 4.1. Notice that the <=) part of Theorem 14. 1 1 was also proved in Corollary 13.21 

Remark 4.2. In the context of undirected graphs, Grone et al. ifTOl prove that every partial 
positive definite matrix can be completed to a positive definite matrix if and only if the 
underlying graph is decomposable. Theorem 14.11 above is the corresponding result in the 
DAG context with the caveat that the result in IfTOl for undirected graphs does not imply 
the result below. In particular, IfTOl implies that D u has to be decomposable if a positive 
definite completion is to be guaranteed for any arbitrary partial positive definite matrix. The 
requirement that the graph D u be decomposable does not however mean that D is perfect. 

Corollary 4.1. Suppose Q is a decomposable graph. Then every Y e Qg can be com- 
pleted to a unique 2 in PD^. Consequently, every partial positive definite matrix over a 
decomposable graph has a positive definite completion. 
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Proof. Let Y be in Qg and let T) be a perfect DAG version of Q. Then T e Q©. The result 
is immediate by applying Corollary 13.21 followed by Corollary 13. 1[ □ 



There is an interesting contrast between completing a given partial positive definite 
matrix Y e in PD^ vs. completing it in PD^. In particular, Theorem 3. in IfTOll asserts 
that r e Qg can be completed in PD@ if any positive completion exists. A completion in 
PD© is therefore sufficient to guarantee a completion in PD^. The other way around is 
not true. In particular, Y may not be completed in PD© even when it can be completed in 
PD^. This is because completion in PD© is more restrictive than completion in PD^. We 
illustrate this distinction in the following example. 




Figure 5: A non-perfect DAG from Example |4J] 



Example 4. 1. Consider the following partial positive definite matrix over the DAG in Figure 



r = 



'1 


12 


12 


16^ 


12 


30 


28 


* 


12 


28 


37 


32 


,16 


* 


32 


38, 



Although T) is not a perfect DAG we have Q, the undirected version of D, is decomposable 
and therefore by Corollary 14. II it can be completed to a positive definite matrix in PD^. 
However, completion of Y in PD© requires that S 42 = r 43 r3 3 1 r32 = 24.2162 and one can 
check that the completed matrix 



(1 


12 


12 


16 


12 


30 


28 


24.2162 


12 


28 


37 


32 


116 


24.2162 


32 


38 



is not positive definite. Consequently, Y cannot be completed in PD©. 

Now suppose that Q is an undirected graph and Y e Qg. When Q is decomposable 
it has a DAG version D that is perfect. Corollary 13.21 and the fact that PD© = PD^ (see 
Proposition 13 .11) imply that Y can be explicitly completed in PD G . However, when Q is not 
decomposable no algorithm for completing Y in PD^ is known, unless a positive definite 
completion in PD p (R) is given or guaranteed. Given Q, in practice, it is useful to know 
whether Y can be completed in some DAG version of this undirected graph Q = D". This 
is because if Y can be completed w.r.t a DAG version of Q, then the completion process 
given in Proposition 13 . 3 1 can be exploited to obtain a positive definite completion, and thus 
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ensuring the existence of a completion in PD^. In the following example we show that even 
when T can be completed in PDg the completion may still not exist for any DAG version 
ofQ. 




Figure 6: Positive definite completion for C4 from Example 14.21 



Example 4.2. Consider the partial matrix 





a 


d 




a 


1 


* 


b 


d 




1 


c 




b 


c 


U 



over the four cycle C4 as given in Figure[6l It is clear that when \a\, \b\, \c\, \d\ < 1, Y is 
a partial positive definite matrix over C4. It is shown in that Y can be completed to a 
positive definite matrix £ if and only if 



f(a, b, c, d) = V(l ~a 2 )(l - b 2 ) + V(l - c 2 )(l - d 2 ) - \ab - cd\ > 0. 

Now consider the list of the DAG versions of C 4 as given in Table [TJ A simple enumeration 
will demonstrate that the list in Table [His exhaustive and contains all DAG version of C4. 

Tabled] gives for each DAG version of C4 the edges labeled with the corresponding entries 
of T. The dashed edges and their labels correspond to the missing edges and entries com- 
puted by using Equation (13.11) . For example, the DAG version in Table [H(l) corresponds 
to the partial matrix 

c * d^ 
1 
b 



Y = 



c 



* 

b 
1 

a 



a 

u 



43 



r _1 r 

33 



32 



ab, which is the 



Here the missing entry S 42 is computed as S 42 = £ P r(2),2 

label on the dashed edge 4 --» 2 in Table[T](l). Note that once the dashed edges are included 
all the DAGs in Table Q] are perfect. Therefore, if the partial matrix over the corresponding 
perfect DAG in Table \T\ is partial positive definite, then by Corollary 13.21 the completion 
in PD© (where D is the original DAG version of C4) is guaranteed. The above reasoning 
allows us derive the required system of inequalities that sensure that Y can be completed in 
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PD^). For example, the partial matrix corresponding to the perfect DAG in Table[H(l) is 

n 

c 



A = 



c * 

1 b ab 

* b 1 a 

y d ab a 1 



A simple calculation will show that the lower right 3x3 submatrix of A is positive 

a c <P 



c 1 ab 
d ab 1 , 



> 0. This is 



definite. Hence A is partial positive definite if and only if 

equivalent to requiring that 

/,=(!- c 2 )(l - d 2 ) - (ab - cd) 2 > 0. 

Similarly, we can show that the partial matrix corresponding to each of the perfect DAGs 
given in Tabled] (2), (3) or (4) respectively, is partial positive definite if and only if 



h 
h 



a 2 )(\ 



d 2 ) - (be - ad) 2 > 0, 



= d 

= (1 - a 2 )(l - b 2 ) - (cd - ab) 2 > 0, or 
= (1 - b 2 )(l - c 2 ) - (ad - be) 2 > 0. 

It is easy to check from Table Q] that the inequalities obtained under the perfect DAGs given 
in Table[U (5), (6), (7) and (8) are the same inequalities already listed above. The partial 
matrix corresponding to each of the perfect DAGs given in Table \T\ (9) or (10) respectively 
is, partial positive definite if and only if 

/ 5 : = min((l - b 2 )(l - c 2 ) - (be) 2 , (1 - a 2 )(l - d 2 ) - (ad) 2 ) > 0, or 

f 6 : = min((l - a 2 )(l - b 2 ) - (ab) 2 , (1 - c 2 )(l - d 2 ) - (cd) 2 ) > 0. 

Now consider the following choices for a, b, c,d: a = 0.6, b = 0.9, c = 0.1, and d = 0.9. 
Then we have /(0.6, 0.9, 0. 1 , 0.9) = 0.3324, but 

/i(0.6,0.9,0.1,0.9) = -0.01 / 2 (0.6,0.9,0.1,0.9) = -0.08 
/ 3 (0.6, 0.9, 0.1, 0.9) = -0.08 f 4 (0.6, 0.9, 0.1, 0.9) = -0.01 
/ 5 (0.6,0.9,0.1,0.9) = -0.17 / 6 (0.6,0.9,0.1,0.9) = -0.17. 

Hence when the above values for a, b, c, d are substituted in T we obtain a partial positive 
definite matrix that cannot be completed in PD S for any DAG version D of C4, although it 
can be completed in PD C4 . 



5 Computing the inverse and determinant of the comple- 
tion of an Incomplete matrix 

In this section we give closed form expressions for the inverse and the determinant of a 
completed matrix PD^ as a function of only the elements of the corresponding partial ma- 
trix. First we need the following notion for undirected graphs. 
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Definition 5.1. Let Q = (V, Y) be an arbitrary undirected graph. 

(z) For three disjoint subsets A, B and S of V we say that S separates A from B in Q if 
every path from a vertex in A to a vertex in B intersects a vertex in S . 

(ii) Let T be a ^-partial matrix. The zero-fill-in of Y in Q, denoted by |T] y , is a | V| x | V| 
matrix T such that 

{Vij if 

1 otherwise. 



T 

1 'j 



We now invoke a lemma required in the proof of the main result in this section. 

Lemma 5.1. Let D = (V, S~) be an arbitrary DAG and let Q = (V, Y) denote the undirected 
version of D. Let 2 6 PD ffl and let (A,B,S) be a partition ofV such that S separates A 
from B in T) m . Then we have 

{a) I" 1 = [(Sau^)- 1 ]" + [(5Wr 1 ] V - [VsT'f and 

{b) det(s - 1) = . 

det(Z AuS )det(S BuS ) 

Proof. Since by Lemma I3TT1 PDn c PD^m the proof directly follows from Lemma 5.5 in 

ma. " □ 

Proposition 5.1. Let F be a partial positive definite matrix in Q that can be completed to 
a positive definite matrix S in PD . Then we have: 



(0 2T 1 = Zf =1 ([(2fa(o) _1 ] V - f(2pa( ! ))" 1 ] y ) and 



nf =1 det(X fa(0 ) n '= l "'P aW 



Proof. Suppose that by mathematical induction the assertion of the proposition holds for 
any DAG with number of vertices less than p. We proceed to prove the proposition for D 
with p vertices. The case p = 1 holds trivially. Thus assume that p > 1. Let V[i] denote 

V \ {1}. The triple (V \ fa(l), {l},pa(l)) is a partition of V, and pa(l) separates {1} from 

V \ fa(l) in D m . Thus by LemmaEH 



- 1 = [(Snmrf + [Wf - [(Z p a(l))" 



(5.1) 



Invoking the same notation used in the proof of Theorem 14.11 note that the partial matrix 
is positive definite over £)[ij with positive completion Ey\{i} in PD S[1] . By the induction 
hypothesis applied to ¥ = we have 

(Evui})" 1 = ^ 1 = ([(^(o)"f tl] " [(^(oJ'T 111 ) ■ (5-2) 

i=2 * ' 

Since is an ancestral subgraph of D, it is clear that for each i 6 V \ {1} we have 

Tfa(i) = £fa(i) and V P pa (,) = 2p a (j). 
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By replacing these in Equation (15.21) and zero-fill-in in D u we obtain 



i=2 > 



(53) 



Finally, substituting Equation (15.31) into Equation (15.11) yields the formula in part (z). Part 
(ii) follows similarly by using part (2) in Lemma I5TT1 . □ 



Remark 5.1. We note that Part (ii) of Proposition l5. 1 l ean also be proved using probabilistic 
arguments (see [ffl[3]|). 



Figure 7: The DAG from Example l5.1l for which S 1 is computed using Proposition l5.ll 



Example 5.1. Let T> be the DAG given in Figure [7] 
(a) Suppose that the D-partial matrix 



r = 



1 Z12 * 2i4 * 

£21 1 * * £25 

* * 1 S34 £35 

S4I * Z43 1 * 

. * 2 52 Z53 * 1 ) 



can be completed to a positive definite matrix S in PD©. By applying part (z) of Proposition 
EH we have 

2T 1 = [(2(1,2,4})-^ + [(2(2,5))'^ + [(1(3,4,5))"^ + [^f 
+ [2£}] V - [(2(2,4,)-^ - [E3] V - [(2,4,5,)-^ • 

Note that all the entries of the matrices involved in this expression are given in F, except 



24 



for E54 and E 42 . By using Equation (13.11) it is easy to check that E 54 = E 42 = 0. Hence, 



E = 



+ 



( 1 E12 S14 

£21 1 

V E 41 1 

'0 0^ 





1 





-1 



+ 



1 

^52 



2 25 

1 



1 - E 2 - E 2 

1 ^12 ^14 



+ 



1 - E 2 - E 2 

1 ^34 ^35 



1 

_ 2 12 



-E J4 



fo 











^0 01 

10 



1 

0) 

-E 12 



-nv M £34 £35 

+ I 43 1 

£53 1 

'0 0\ 





1 

1 



1 -E 2 

1 ^14 





2 12 Zi 4 





1 

_ ^34 

-235 











-£34 

1 

^34^35 



-Ei 4 

E 12 E 14 


1 - 





E 2 
^12 






0) 



+ 



1 



1 - E 2 

1 ^25 



E 2 
^35 






^34^35 



1 



Y 2 



+ 



'0 









-1 







(0 















1 




-2 25 





-1 















N 








"2-25 




1 



By combining these terms into one matrix we have E 1 is equal to: 



- 1 



-£ 12 







-^14 



12 "14 





I-2 2 ~Y? 
1 ^12 14 



i-sf 



1 -Y? -2 2 
1 ^12 ^14 



+ 







1-2 2 

1 2, 25 



~2l4 
1 ^12 ^14 

^12^14 
i-^2-^4 



~^34 



1-2; 



£|2^14 



'34 "35 
234 



1-2 2 
1 2 -|2 



1-2 



2 _y2 
12 ^14 

^25 



1-2: 



'34 "35 
2 3 5 



1-2 



1-2 



+ 



1-2 



1-2 2 
25 



I-2 2 -2 2 
1 ^34 ^35 



J 14 1 i 34 

234235 
1 _y2 _y2 
1 ^34 ^35 



-X 2 
^35 



l-2 2 5 
-2 3 5 

1— y 2 — y 2 

1 ^34 ^35 
234235 



1-2: 



1-2 2 
1 ^34 

1 _y2 _y2 

1 ^34 ^35 



34 "35 
1 



+ 



I-2 2 

1 2, 25 



- 1 



Similarly, using part (ii) of Proposition [5TT] we have 



detCE" 1 ) = [(1 - E 2 2 - E 2 4 )(l - 2*5X1 - E 2 4 - E^)]" 1 . 



(b) Let us apply the computation of the inverse matrix in part (a) to the following specific 
D-partial matrix 



r = 



4 


-2 


* 


1 


* 


-2 


2 


* 


* 


-1 


* 


* 


3 


1 


-1 


1 


* 


1 


1 


* 


* 


-1 


-1 


* 


1 
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Using the completion process in Proposition 13 .31 one can check that the completion of Y in 
PD ffl is given as 



From this we obtain 





_9 


n 

u 


1 

1 


1 1 




_9 


9 


1 


yj 


-1 






1 

i 




1 
i 


-1 




1 


n 


1 

1 


1 







V 1 


-1 


-1 





1, 




' 1 


1 





-1 


01 


1 


2 





-1 


1 










1 


-1 


1 


-1 


-1 


-1 


3 




1 


,0 


1 


1 


-1 


3 


> 



However, without completing Z and with less computation, we can compute Z 1 using the 
results in Proposition 15. II For this, we apply part (a) above. First let D = diag(4, 2, 3, 1, 1) 
and T = zHr/ri Thus 





' l 


-0.71 


* 


0.50 


* 




-0.71 


1 


* 


* 


-0.71 


r = 


* 


* 


1 


0.58 


-0.58 




0.50 


* 


0.58 


1 


* 




, * 


-0.71 


-0.58 


* 


1 



If Z denotes the completion of r in PD©, then by using part (a) we obtain 



' 4 


2.83 





-2 


^ 


2.83 


4 





-1.41 


1.41 








3 


-1.73 


1.73 


-2 


-1.41 


-1.73 


3 


-1 


{ o 


1.41 


1.73 


-1 


3 J 



From this we can obtain Z 1 = D ^Zq 1 /) 2, which as expected turns out to be same matrix 
as the one given in Equation (15.41) . 

Example 15.11 demonstrates that the inverse and the determinant of the completion of a 
partial matrix Y in PD a can be computed using the expressions given in Proposition 15. 1[ 
and generally, avoid recourse to the whole completion process. This is especially so when 
D is a perfect DAG. Since in this case Zf a (,), and consequently Z pa(( ), are already blocks of 
the partial matrix Y, the computations can be carried out without recourse to the completion 
process in Proposition 13.31 This fact about perfect DAGs can also be deduced from their 
relationship to undirected decomposable graphs (see Lemma 5.5 in tfT2l ). 
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